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Abstract 

A survey of some evaluation work on discrete reliability growth models 
is presented. Extension of an accurate exponential growth model is pro- 
vided that uses regression analysis to fit the natural logarithm of the failure 
rate 1 — p in the geometric distribution. Some useful theorems and relation- 
ships are developed that provide estimates of reliability which have better 
properties than the usual maximum likehood estimates. The effect of dis- 
counting is portrayed with graphs that allow comparison among different 
failure discounting methods and their affect on different models. 

Keywords: Reliability Growth, Failure Discounting, Reliabihty Esti- 
mation. 



1 SUMMARY 

Reliability growth models and their use in the acquistion of systems by DOD 
agencies have become more important in recent years. They are used not only 
to track reliability growth, but also to verify reliability requirements. It is im- 
portant that these models track reliability change accurately. This tracking 
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accuracy can be determined by application of computer simulation. The re- 
sults of simulating several reliability models that utilize discrete test data are 
reviewed in this paper. 

How to dispose of past failures after their cause has been removed by appro- 
priate changes in design or production has been a problem of interest for many 
years. Removal of a failure, or a fraction of a failure, from the test data is called 
failure discounting. 

The results show that discounting definitely affects the accuracy of a relia- 
bility growth model. Certain types of failure discounting improve the accuracy 
of some reliability growth models analyzed. One type of failure discounting, 
which is in use today, decreases the accuracy of some reliability growth models 
analyzed. 

2 BACKGROUND AND FOUNDATIONS 

Let X(r) denote number of independent trials to r failures with probability p 
of success on each trial. The probability distribution of ^(r) is the well known 
Pascal distribution with probability mass function: 

^ r - 1 ] ~py x = r, r + 1,.... 

We say X(r) is P(p,r) to denote this probability. For r = 1, X{1) denotes 
trials to first failure. If denotes trials between failure numbers j — 1 and 

i, i= l,2,...,r, then, 

X{r) = Xi{l) + X2{l) + --- + Xr{l), 

Mission testing is frequently performed on items until r failures occur, at 
which time some change is made that hopefully will increase the probability p of 
success for subsequent trials. Let pk denote the probability of success (reliability) 
after modification number k. Thus, •• > denote reliabilities of the items 
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under test in phases 0, 1,2, . . .. We can model as follows: 

pt = 1 _ a + bk>0, A: = 0,1,2,... 

= 1 - e"^*. 



( 1 ) 



This model has become known as the discrete exponential reliability growth 
model. It first appeared in reference (l). It W 2 is first evaluated by computer 
simulations in reference (3). In each phase, we seek current estimates for a + bk 
using test data from the previous and current phases. In this model a -j- bk = 
— In (l — pk). Since 1 — pjt is the failure rate, the problem is one of fitting the 
negative natural logarithm of the failure rate. Regression methods have been 
used to make this fit. One such method is described in detail in Section 4. 

Some readers may prefer to estimated pk directly using well known estima- 
tion results for this class of probability distributions. Since A'’(r) is a complete 
sufficient statistic for pk , it can be shown that a uniformly minimum variance 
unbiased estimator for pjt is 



Pk 



Mr) - r 

X{r) - 1 
0 



ifX(r) > r 
= r 



In development programs it may be desireable to take r = 1. In this case the 
uniform ly minimum variance unbiased estimator for pjt is 

f 1 if A(l) > 1 

jo if A(1) = 0 

This is hardly a desirable estimator since pjt will never be 0 or 1. 

In any event some model is needed for pk that reflects changes in hardware 
reliability due to changes in the acquisition process. Since changes can improve 
or degrade reliability, a model (including the estimation procedures) should have 
the ability to track both degrading reliability and reliabililty growth. 
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2.1 Point Estimation Using Trials Between Failures 

Suppose X is P(p, l) and p = 1 — e~^. Then the probability mass function /(x) 

f - P), 2 ; = 1,2,... 

/W = 

I 0 , elsewhere. 

The maximum likehood estimator (MLE), p+, for p is p* = {X—\)/X. This 
estimator has negative bias. An estimator with less negative bias is p = 1 — 
where A is unbiased for A, A is obtained as follows: From equation (1), 

2 3 

A = - ln(l -p) = p+ ^ + y+ .... 

If g(x) is unbiased for A then, 

3 

^ ^ ^ + • • • • ( 2 ) 

x=l 

The left member of equation (2) yields 

(l-p) [ 5 ( 1 ) + i/( 2 )p + 5(3)p^ + ...] =i/(l)+p(5(2)-i/(l))+p^(5(3)-(?(2)) + .... 

Equating coefficients of this polynomial with those of the right member of equa- 
tion ( 2 ) we obtain 

f 0 , X=1 

S(X) = I , , . (3) 

Therefore, A = g{X) and p = 1 — e“^. Of course p is not unbiased for p, but 
the following theorem is useful. 

Theorem 1: If X is P(p, 1 )^ A = g{X)j p=\ — p* the MLE for p then 

1 . E{p*) = 1+ ^^ln(l -p) 

2 . p* < p for all X > 1 
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3. E{p*) < E{p) < p 



where g{X) is defined by equation (3). The proof follows: 
1. Ejp*) < p: 



X-1 , 1 






= £%'-(> -p) 



Thus, 



(1 - p) + ^ p(i - p) + ^ p^(i - p) 



p p^ p^ p* 

i-p + -- — + — - — 
^ 2 2 3 3 



ln(l -p) - -ln(l -p). 
P 



E{p*) = l-ln(l-p) + iln(l-p) 






2. p* < p for all X > 1 : (by induction) 



( 4 ) 



Since ex > 1 H — for all a: > 1, then 

X 






( 5 ) 



a) for I = 2, p* = -, p = 1 - e ^ = .632 



b) suppose for some interger x > 2, p* < p. Then, 



1 


( 1 


1 


M 


1 < 1 — exp 

X 






)J 



( 6 ) 
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i,e. 



In ,<I + i + „,+ ^. (7) 

From equation (5) 

In ^1 + -^ = In (x + 1) - In (x) < - (8) 

adding equation (7) and (8) we obtain 

ln(i+l) < l + ^ + ... + i. (9) 

2 X 

This establishes (6) and (7) for all integers > 1. Therefore, p* < p for all x > 1. 
3. E[p*) < E[p) < p: 

p* < p implies E{p*) < m ■ 

Also p{A) = 1 — is convex up in A and p{A) = p. The derivative of p{A) 
at A = A is and is the slope of the tangent line to p(A) at A = A. This 
tangent line is 

L{A) = p{A) + e~^{A - A)= p + e“^(A - A). 

From convexity of p(A), 

p{A) < L{A). 

with equality only at A = A. Therefore 

E{p{A))<E[L{A)] = L{E{A))=p. 

Suppose A(r) is P(p,r,) and i — l,2,...,r denotes the trials between 
failures. Then A,- = 1 + | + . . . + unbiased for A = — In (1 — p). Conse- 

quently, A = ^ Yli Ai is also unbiased for A. The estimator p = 1 — exp( — A) is 
an improved estimator for p. We shall see in section 2.4 that there is a better 
estimator for A using 

i:Xi = X{r). 

»=i 
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2.2 Characteristrics of p and p^ 

Even though E[p^) < E[p) < Py p may not be preferable to p*, unless var[p) = 
var{p*). More specifically, it would be desireable to have the mean squared 
errors compare favorably: i.e., we would like 

E{f> - pY < E{p * -pY 



for values of p in the ranges of interest. Expressions for the mean and the 
variance of p* are as follows: 



E{p*) = l+(^)ln(l-p) 



var 



— j = var[p*) = 
x; 



1 OO 

1 - P 1 






1 - p 



ln(l - p) 



The mean and variance of p will be approximated. It is of interest to note that 

1 



varj 



(see ref(l)). Table 1. presents some values of p, E[p*), E{p), var [p*], var [p), 
MSE{p*)y MSE{p), Most of the values were obtained from computer simula- 
tions using 10,000 observations. Table 2. affords a comparison of p* with p for 
various values of A". 



p 


E(p*) 


E(p) 


var[p*) 


var{p) 


MSE(p*) 


MSE(p) 


.5 


.307 


.357 


.102 


.137 


.141 


.157 


.6 


.389 


.451 


.112 


.143 


.157 


.166 


.7 


.484 


.547 


.115 


.140 


.163 


.163 


.8 


.598 


.661 


.107 


.121 


.149 


.140 


.9 


.744 


.797 


.079 


.080 


.103 


.090 


.95 


.842 


.881 


.051 


.047 


.062 


.052 


.97 


..892 


.921 


.035 


.031 


.040 


.033 


.99 


.953 


.968 


.014 


.012 


.015 


.012 



Table 1: Statistical Characteristics of p* and p 
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X{1) 




P 


5 


.800 


.875 


10 


.900 


.941 


20 


.950 


.971 


150 


.993 


.996 



Table 2: Values of p*, p and X{l) 

2.3 Point Estimation Using X(r) 

When testing items until r fail, the number of trials between failures Xi, 
Xrjmay or may not be recorded. Either way X(r) is observed and it is a complete 
and sufficient statistic for p. It is also sufficient for — ln(l — p); i.e. for A. 
Therefore, there is an unbiased minimum variance estimator p(X(r)) for A. The 
unbiased estimator A discussed after Theorem 1, is unbiased, but may have 
larger variance or mean squared error than p(X(r)). Since X(r) is P(p,r), we 
could construct ofXfr)) as before, by writing 

and equate coeffecients of both members of this equation. Instead, we construct 
p(X(r)) using recursive relationships. 



Theorem 2: If X{r) is P(p,r)^ p = 1 — e then 



9iX{r)) = 



1 1 1 

r^r+l"^ X{r) — I 



iiX{r) = 
if X{r) > 



is a minimum variance unbiased estimator for — In (1 — p) = A. 



r 



r 



Proof: 

Suppose X(r) is P(p,r) and, let ^r(X(r)) be an unbiased estimator for 
— ln(l — p). Likewise, for X(r + 1), let hr{X{r + 1)) = + 1)). We 

shall drop subscripts and write 

X is P(p,r), Y is P(p,r + 1) 
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and let g{X) and /i(F) be unibiased estimators for — ln(l — p). 
Case 1: r — \ 

We know from equation (3) that 






0 if X = 1 

1 + - + ... H if X > 1 

2 X - \ 



Since both and h{Y) are unbiased for the same quantity, 

OO _ 1 \ 

(1 - p) E = (1 - p? E M*) E p"’- (10) 

2=1 2=2 V / 

Dividing out (1 — p), expanding the resulting R.H.S, of (9), transposing one of 
the resulting series to the L.H.S., and using the fact that ^(1) = 0, we have 



OO OO 

2=2 2=2 

Writing x as 1 + j\ (r + j where r = l), eq.(lO) becomes 

OO OO 

Y [^?(l + j) + + i)lp^ = + iby“*- 

j=i y=i 

From equating coefficents, 



(11) 



1. h{2) = 0 

2. g{l+j)+jh{l + j) = h{l +j+ l){j + 1), 



or 



If J = 1: 

Ifi = 2: 

By induction, suppose 



h{l+j + 1) = 
h{3) = 



g{l+j) + jh{l + j) 

j + 1 

p(2) + 0 _ 1 



^( 3 ) + 2 ( i ) 1+1 + 1 _ 5 _ 1 1 

^ = 3 - 6-2 + 3 - 



. , N 1 1 1 

M1+J)=2 + 3+--- + 7- 
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Then 



/i(i + y + i) = 



g(i +y) +y/t(i + y) 
y+i 



= /+i+-+)+y(i+...+ 7)]-(i+i) 



Thus, 



1 1 1 

- 2 + 3 + '"+7TT' 



^( 1 +y) - 2 + 3 • • • + y> i-2,3, 



Since h(X(2)) is the unbiased estimator for A when r = 2, it follows that 

r 0 X{2) = 2 

5 + 5+-X(2)-1 ^(2)=3.‘‘.-- 



'>(^( 2 )) = 



Case 2: r > 1 (by induction) 

Suppose 

X is P(p, r),y is P(p, r + l),p(A^) and /i(y) 
are unbiased for — ln(l — p). Then 

|:/(-) (*:,') p-'(' - p)' = tnp) ( " ; ' ) 



(i-pr‘. 



Dividing out (1 — pY, expanding the resulting R.S.H. of the equation and sup- 
posing g(r) = 0, and p(r + y) = ^ + . . . + ;qrpi, we obtain, 



E 

a;=r+ 1 



loW+l % ' )'■(*) 



p”'= E ( % ‘ ) 

z=r+l V / 

( 12 ) 



Setting X = r + j\ equation (12) becomes 



E 

y=i 






P' = E 

y=i 



r+y- 1 

r 



1 ^(r+y)p^‘ 
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Equating coefficients, we get 



1 . /i(r “hi) — 0 

2 . 



h{r+j+l) 



r + j - 1 
r - 1 



p(r -h j) -h 



r+j-1 

r 




h{T + j) 
( 13 ) 



Ify= 1: 



h{r + 1 “h 1) 



^ r + 1 j »•('•+ 1) »■ + 1 



If j = 2: 



h[r + 1 + 2) 



( '!! )«(^+2)+ ( j^-'+i + i) 

r + 2 

r 

1 1 
r + 1 r+2 



( 14 ) 



By induction, suppose 



/i(r + 1 + j) - 



1 

r + 1 



+ 



1 

r + 2 



+ 




( 15 ) 



Then 



h{r + 1+ j + 1) 



r + i + 1 
r 




( 16 ) 
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Since, 



r + j 

r - 1 



r + j+1 

r 



r + j + l 



r+J 

r 



r + j+1 



i + 1 

r+j+1 



equation (16) becomes 

+ + ^ ^»(^ + j + , l . ) + (4 + . l . )Mr + J + l) 

^ ^ r + j + 1 



r + ;^ + • • • + U + 1) [rh + + • • • + 7^] 



r+j+1 



Thus, 



1 1 1 

+ — ^ + --- + — ^ + 



r+1 r+2 



h{r + j+l) = 



r+J r+j+1 

j = 0 



1 1 
r+ 1 r + j 



Since h[X{r + 1)) is the unbiased estimator for Ar+i it follows that 
( 0 X{r + 1) = r + 1 



+ 1 )) = < 



1 



+ ...+ 



1 



— , X(r + 1) — r + 2, r + 3, . . .. 



r+1 ^(r + 1) 

The induction has been established for any r. Thus, if X(r) is P{p,r), r > 1, 
then an unbiased estimator, g(X(r)), for — ln(l — p) is 
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The corresponding estimator for p \s py. — \ — exp( — A^). Since Ar is a 
function of X only, and since X is a complete sufficient statistic for p, then from 
the Lehman-Scheffe theorem, Ar is a uniformily minimum variance unbiased 
estimator for A = - ln(l - p). Also E[pr) < p by using a proof similar to the 
one used to show that E{p) < p. 

Table 3 provides a comparison of the statistical proporties of p 3 with those of 
p described at the end of Theorem 1. The comparisons are the result of 10,000 
computer replications of sampling from P(p, r = 3), i.e. testing until 3 failures. 



p 


E{1>) 


E{pz) 


MSE(p) 


MSE(p3) 


.5 


.450 


.452 


.0537 


.0538 


.6 


.548 


.551 


.0516 


.0493 


.8 


.757 


.763 


.0293 


.0248 


.9 


.872 


.876 


.0120 


.0094 


.95 


.933 


.936 


.0043 


.0032 


.99 


.985 


.986 


.0025 


.0017 



Table 3: Statistical Characteristics of p and p 3 (r = 3) 



It is interesting to compare the values of p in Table 2 (r = 3) with those of 



p in Table 1. (r — l). 



3 RELIABILITY GROWTH IN ACQUISITION PRO- 
GRAMS 

Reliability growth methods were developed as early as 1962, primarily for use 
in major DOD acquistion programs. Reference (1), presents several RG models, 
including the discrete exponential (DE) model. Reference (2) evaluated many 
reliability growth models in the open literature, and other sources, at the time 
of the publication. It showed the DE model had some of the most accurate 
characteristics among all growth models considered. Reference (3) presents the 
results of numerous simulations of a modification to the DE model. Reference 
(4) is a refinement and extension of Reference (3). 
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Reliability growth methods were used for many years in early development 
phases of acquisition programs as a management tool to indicate trends in growth 
patterns. They were not used to demonstrate reliability requirements, because 
numerous demonstration tests were performed for that reason. MILHDBK 189 
(reference 7) was developed under that concept. In October 1986, DOD issued 
reference (5). This document, recent RFP’s, and funding policies have dimin- 
ished the amount of demonstration testing. “Reliability testing” is performed 
during the development phases to induce failures, make corrections, and test 
again. This type of testing program results in changes in the design and man- 
ufacturing processes. One consequence of such a program is the need to track 
growth in reliability. These new changes in testing philosphy and reliability 
measurement are evident in references (5) and(8). 

4 EXPONENTIAL RELIABILITY GROWTH MODEL 

4.1 Description of the Model 

The model assumes that a type of component will see several phases of improve- 
ment during that portion of its life cycle to which the model is applied. Rk 
denotes reliability in the phase or modification to the type of component. 
Specifically, the model is 



Rk = 1- exp{-(a + ^K)} (17) 

for K = 0,1,2, The if = 0 phase denotes the phase prior to any modifi- 

cation. The model assumes testing is performed in each phase until a specified 
number of failures are observed at which time a change may be made. No as- 
sumption is made about the distribution of the time to failure. Only attributes 
data are used with this model. Estimates 6t and /? are updated as new test data 
(new phase) becomes available due to testing subsequent to a modification in 
the design or manufacturing process. This data may, or may not, be mixed with 
test data from previous phases. All data from all previous phases are used in 
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the estimation methods presented here. 

The estimates and for a a and /3 at the end of the phase are 
obtained using linear regression methods and an unbicised estimator for 
The data collected during testing in the phase is the following: Fx = the 
total number of failures during the ph 2 ise, and Nj x = the number of test 
between the {j — 1)^^ failure and the failure, including the failure, in the 
phase, j = l,2,...,Fx. 

An unbiased estimator Yjx of the quantity [a + /3K) using the sequence 
of tests in phase K is given by (Reference l). 






0 if Nj-^x = 1 



for K = 0, 1, 2, . . . and j = 1, 2, 3, ... , Fx^ Since each Yjx is unbiased, 



(18) 



Yk = [Y,k + Y2K + ... + Yf^^)/Fk 



is unbiased. Then least squares estimates ocx and ^x for a and ^ at the 
phase are 

EO' - KWi 

h = ( 19 ) 

Y.U - 

;=0 

and 

= F - ^kK (20) 

for a: = 1,2,3,... , where Y = (Fq + Fi + . . . + yK)/(A' + 1) and Z= (1 + 2 + 
... + K)/[K + l). 

Finally, these and estimates are utilized in the discrete reliability 
model, equation (15), to produce sequentially, the model estimates of the modi- 
fied component reliabilities Ri, R^, ■ ■ ■ from the equation 

Rk = I - exp{-{oiK + ^kK)} ( 21 ) 
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for K — 1,2,3, .. .. Note that since the regression procedure requires a minimum 
of two observations, model reliability estimates are produced from the first mod- 
ification thru the last modification. A reliability estimate for original version of 
the component is 

.Ro = exp{-Fo}« (22) 

4.2 FAILURE DISCOUNTING 

Reduced testing support, new funding policies and new DOD documents, such as 
reference (5), in the acquisition process require maximum use of small amounts 
of test data to obtain reliability estimates. Human judgment by both contrac- 
tor and customer personnel have played a larger role in reliability assessment - 
particularly in deciding what data to use to estimate reliability and track reli- 
ability growth. Failure analysis and review frequently generates a change that 
both contractor and customer feel have removed the cause of failure. It may be 
desireable to reduce the affect of the original failure on the reliability estimate 
since it is believed to have been “removed” . 

This raises the question of what to do with the recorded failure in the data. 
One method for failure removal is to remove fractions of a failure, repeatly, as 
more testing is accumulated without failure for the same cause. By some rule, 
or agreement, fractions of such a failure are removed until all, or nearly all, of 
the failure is removed. If the same failure cause reappears, the orginal failure is 
restored and, perhaps, the rule for removal of fractional failure for this or any 
other cause may be tightened due to the reduced confidence in ability to remove 
failure causes. 

Accuracy of reliability growth models with or without failure discounting can 
be readily examined by computer simulations. Several reliability growth models 
have been simulated under a variety of testing and discounting plans by Drake 
(9) and Chandler (10). 
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4.3 Discounting Methodology 

Once a system weakness has been corrected, and improvement validated through 
further testing, fractionally discounting the past failure is a method of reflecting 
the improved system reliability in the previously collected data. If a proper 
discounting methodology can be developed, failure data from all past phases 
could be discounted and made compatible with the data from the current phaise. 
Regardless which discounting method is used, experience and good engineer- 
ing judgment will be necessary to choose input parameters to the discounting 
method. If improper parameters are applied, the model may consistently over 
or underestimate system reliability. Computer programs have been written by 
Drake (9) and Chandler (10) that allow a user to examine the afTect of discount- 
ing on specific reliability growth models and testing programs. The following 
sections describe the specific steps for applying two failure discounting methods, 
including examples of their use. 

a. Straight Percent Discounting Method 

The Straight Percent Discounting Method removes a fixed fraction of a failure 
each time a predetermined number of trials are observed without re-occurrence 
of the failure cause. The fraction of a failure removed, F, is referred to as the 
discount fraction. After the initicJ occurrence of a particular failure cause, any 
trial in which the failure cause is not repeated is considered a success. The num- 
ber of successful trials between applications of the discount fraction is referred 
to as the discount interval, N. Both N and F are input parameters to be speci- 
fied by the user of the simulation programs written by Drake (9) and Chandler 
(10). They remain constant throughout failure discounting computations. In 
this discounting method, the computer records the number of successful trials, 
M, since the last occurence of each observed failure cause. Failure discounting 
is performed at the end of each testing phase using the values for N, F, and M. 
Detailed explanations of this method are provided in references (9) and (10). 
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b. Upper Confidence Bound (UCB) 

The underlying premise of the UCB Discounting Method states that the 
fraction of a failure removed by the discounting method should not be arbitrarily 
chosen. Some statistical basis should be used to determine how much of a peist 
failure remains after each successful test subsequent to failure and corrective 
action. The UCB procedures takes the upper confidence limit for the probability 
of failure to be the fraction of the failure that remains. This confidence limit is 
recomputed after each successful test subsequent to the corrective action taken 
in response to the failure. This technique allows the user to control the amount 
by which failures are discounted by specifying the level of confidence bound. 
A single input parameter, the confidence level 7 , is required to perform failure 
discounting. This discounting method was proposed by Lloyd ( 6 ), 

The UCB discounting equation is given as 

ADJUSTED FAILURE; ie, UCB = 1 - (1 - 7 )^/^ for M > 0 

= 1.0 for M = 0 ■ 

5 SUMMARY OF ACCURACY ANALYSIS 

The simulations performed by Drake (9) allowed for 10 sequential testing phases. 
There were 5 possible statistically independent failure causes in each phases. Ini- 
tial failure probabilities are assigned to each failure cause. A single discounting 
fraction is also assigned. A probability of correcting a failure causes whenever it 
occurs is assigned to each failure cause; consequently, the actual growth pattern 
on any one replication is random depending on the actual failures and fixes. The 
percent increase in reliability following a failure fix is also an input parameter. 
Simulations are performed with and without failure discounting. The number 
of successive success before discounting is applied is also an input variable. 

Chandler (10) extended the computer program written by Drake to permit 
the user to set the actual reliability in each phase. This allows the user to ex- 
amine the accuracy of the grov^h models for specific growth patterns; i.e., for 



18 



specific phase reliabilities Pi,P2> • • • ,Pio which the user specifies. Chandler ex- 
tends Drakes’s program in other ways and examines features of growth patterns 
for which specific discounting methods and growth models are reasonably accu- 
rate. Figures 1 through 19 have been selected from Drake (9) and Chandler (10) 
to provide a summary of the accuracy of the DE and other reliability growth 
models. 

The following notation is used in the Figures 1 through 19 which are graphical 
representations of the accuracy of the growth models analyzed: 

F: fraction of remaining failure removed each time a discount is made. 

I: number of successful tests without failure before the next failure discount can 
be made. 

Example: If F=.2 and 1=5, then after a failure occurs and correction made, 
the one failure for that cause is reduced to .8 of a failure if no failure for the 
same cause occurs in the next 5 tests. It is reduced to .64 if 5 additional success 
are recorded. Anytime a failure for the same cause re-occurs the failure value is 
restored to 1. 

MLE Single Phase: the name of the growth model that computes the relia- 
bility in each phase by (number of successes that phases) (number of 
tests in that phase). 

MLEFD: the name of the growth model that computes the reliability in the 
phase by 

(total number successes in first k phases) -r (total number of tests in first 
k phases). 

Exponential Regression: The discrete exponential regression model. 

Actual Reliability: The reliability values assigned to each phase by the user. 
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The reliability values for each phase for a specific growth model (e.g. expo- 
nential regression) is the average of 500 reliability values obtained by replicating 
the 10 phases of testing 500 times via computer simulations. Consequently, the 
points on the growth ‘^curves” represent the average or expected value of the 
reliability estimates for the actual reliabilities. Ideally the growth curves would 
be the same as the actual reliability curve and the standard deviation would be 
very small. The standard deviation curves are the sample standard deviations 
taken from the 500 replications. 

The test plan in Figures 1 through 19 is to test until 1 failure occurs in each 
phase. This implies that a change (correction) is made after each failure. The 
number of failure-causes is the same from phases to phase. The change may 
not have totally removed the cause of the failure. It may have only reduced the 
likelihood that it will occur. Alternatively, it may mean that a new mode of 
failure, less likely to occur, was introduced with the corrective action. 

Instead of 5 failure causes per phase, one may wish to think of a system with 
5 components in series. The program will permit any number of phases and any 
number of causes per phase. If it is desired to simulate a case where each failure 
cause is removed with probability one, this can be done using Drake’s program 
with probability of fix equal to one and the number of phases less than or equal 
to the number of causes. 

Figures 1-19 present graphical results of simulations for 6 different growth 
patterns each with various combinations of I and F, and two values of confidence 
level for the Lloyd discounting method. Recall that 1=1 in the Lloyd discounting 
method. 

In general the following conclusions can be from Figures 1-19. 

1) The MLEFD Method is highly sensitive to failure discounting. This method 
is commonly used in industry. 

2) The exponential regression method is consistently more accurate than the 
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other models and is not very vulnerable to failure discounting. 

3) Failure discounting improves the exponential regression method in many 
cases. 
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